im 



Arizona State 
University 



Colorado 

University of Cobrado at Boulder 



the 

School of 
Education 



EPRUI 



Education Policy 
Research Unit 



EPIC 



I Education 
' pithur' 
Interest 
Center 



Document Reviewed: 


“The High Cost of High School Dropouts in Ohio” 


Author: 


Matthew Carr 


Publisher/Think Tank: 


Buckeye Institute for Public Policy Solutions 


Document Release Date: February 2009 


Review Date: 


March 4, 2009 


Reviewer: 


Sherman Dom 


E-mail Address: 


Sherman . dorn @ gmail .com 


Phone Number: 


(813) 205-6143 


Suggested Citation: 

Dorn, S. (2009). Review of “The high cost of high school dropouts in Ohio. ” Boulder and 
Tempe: Education and the Public Interest Center & Education Policy Research Unit. Re- 
trieved Fdatel from httD://eDicpolicv.or2/thinktank/review-the-hi2h-cost 





Summary of Review 

A new report published by the Buekeye Institute for Public Policy Solutions is a minor 
variant on six similar reports published by the Friedman Foundation over the past three 
years. The new report repeats some of the errors in the previous reports, and it follows a 
parallel structure, arguing that the costs of dropping out are dramatic for the state of Ohio, 
and that last-chance charter schools for dropouts can increase graduation and address the 
dropout problem. However, the report’s claims about graduates for the 23 illustrative 
schools are inconsistent with the data reported by the state of Ohio for the year chosen, re- 
sulting in a dramatic overstatement of the graduation rates at the charters. The report also 
largely ignores the existing research literature on the personal and social benefits of educa- 
tional attainment, the achievements of charter schools, and the factors associated with ei- 
ther completing or dropping out of high school. Further, the report fails to compare the al- 
leged benefits of last-chance charter schools with plausible alternatives. State policymakers 
interested in increasing graduation would be better served by seeking out the available, 
well-researched scholarship on the topic. 
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Review 



I. Introduction 

For almost half a century, school reform ad- 
vocates in the U.S. have pointed to high 
school dropout rates as a serious problem 
needing to be addressed. These advocates 
often then propose their own proposals to 
address the problem and reduce the individ- 
ual and social costs of dropping out.^ The list 
of reforms proposed as dropout prevention, 
remediation, or amelioration include remedial 
education, vocational education, work-study 
programs, individualized counseling or social 
work, day care for students with children, 
pre-school access, early-childhood and ele- 
mentary-school interventions, middle-school 
academic and behavioral interventions, high 
school academic and behavioral interven- 
tions, expanding the curriculum beyond tradi- 
tional academics, confirming the central 
place of traditional academic curricula, re- 
taining more students in a grade, reducing 
grade retention, requiring students pass ex- 
ams to earn a diploma, eliminating gradua- 
tion exit exams, and quantifying and setting 
targets for graduation. 

In The High Cost of High School Dropouts 
in Ohio^, a report sponsored by the Buckeye 
Institute for Public Policy Solutions, author 
Matthew Carr has expanded the list of pro- 
posed solutions to now include public fund- 
ing for students to attend last-chance charter 
schools. Carr’s argument is that spending 
public funding for these charter schools will 
result in a substantial increase in high school 
graduation. 

The first half of the report presents an analy- 
sis that largely duplicates reports that the 
Milton and Rose D. Friedman Foundation 
published or co-published for six different 
states: Missouri, Indiana, Texas, South 
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Carolina, North Carolina, and Maryland. 
The beginning of the new Buckeye report 
parallels the structure of the Friedman 
Foundation reports, with the details of the 
arguments changed in a formulaic manner. It 
offers crude estimates of the social costs of 
dropping out for that state, and then uses a 
limited set of data about charter schools 
(most of which are run by a controversial 
for-profit education management company: 
White Hat Management) to estimate in- 
creases in graduation and attendant savings 
for the state if more public-school funding is 
diverted to these for-profit charter schools. 

As in the six Friedman publications, the 
Buckeye report uses the existing literature 
on dropping out and school competition in a 
superficial way. In describing the urgency of 
the issue, it uses cross-sectional comparisons 
of earnings and the comparative social bur- 
dens of high school graduates and dropouts. 
That is, it looks at a slice of the population, 
comparing the earnings of those with and 
without diplomas. While such cross- 
sectional analyses are commonly used in the 
public debate over dropping out, they are 
inaccurate for a variety of reasons discussed 
in some detail later in this review. Further, 
while there are acknowledged social benefits 
to increasing educational attainment, the size 
of that benefit is a matter of vigorous debate. 

This report is unique in that it sees a set of 
last-chance (“dropout recovery”) charter 
schools as the best solution to the problem. 
In the parallel reports published by the 
Friedman Foundation, vouchers are the 
panacea; in this report, the solution is found 
in White Hat’s charter schools. 

Surprisingly and as described later in this 
review, the report’s claims about the number 
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of graduates coming from the chosen set of 
charter schools (using data from 2004-05) 
fails to match the official data reported for 
that year hy the state of Ohio — in each case 
exaggerating the total graduate count. 

Finally, the report fails to put the recommen- 
dation for last-chance charter schools in the 
context of possible alternatives. For instance, 
if state policymakers are considering school 
choice, the potential effects of charter schools 
operated by non-profit organizations could be 
compared with the potential effects of choice 
in local public systems. Without a compara- 
tive analysis of alternative proposals to in- 
crease high school graduation, the reports are 
of little practical use to policymakers who 
have no means by which to gauge the value 
of these charters versus other alternatives. 

II. Findings and Conclusions 
OF THE Report 

The report makes the following argument: 

• Ohio’s high school graduation rate is too 
low. 

• There are social costs associated with 
these low levels of high school graduation, 
including lower tax revenues and higher 
costs of medical care and incarceration. 

• Enrollment of high-risk teenagers in last- 
chance charter schools can increase the 
graduation rate. 

The conclusion of the report is a recommen- 
dation that the state expand investment in 
last-chance charter schools to increase the 
graduation rate and save resources. 

III. Rationales Supporting 
Findings and Conclusions 
OE THE Report 

There are three main factual claims in the 
report, concerning (a) the extent of dropping 
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out, (b) the social costs of lower attainment, 
and (c) the benefits of “dropout recovery” 
programs in specialized charter schools. 

Dropouts 

The first figure compares the report’s esti- 
mates of the state’s population aged 25 and 
over — primarily contrasting those with no 
high school diploma to those with a high 
school diploma, with some college experi- 
ence, and with various levels of higher edu- 
cation degree recipients. 

Illustrating Costs 

The next section of the Buckeye Institute 
report attempts to quantify the costs of lower 
attainment. The report contrasts cross- 
sectional data on the unemployment rate, 
income, use of Medicaid, and incarceration 
rates for three groups: dropouts, high school 
graduates, and residents with some higher 
education. For example, the report asserts 
that high school graduates earn approxi- 
mately $6,000 more per year and have an 
unemployment rate at least 6.8% higher than 
any other group of state residents. 

The report then aggregates the individual 
statistics to assert that the total cost of drop- 
ping out is the per capita difference in costs 
between dropouts and high school graduates 
(private income, lost taxes, increased bur- 
dens through Medicaid or prison) multiplied 
by the total number of dropouts in the state. 
The report estimates the total annual costs of 
dropping out to include $6 billion in lost 
wages, over $250 million in lost tax reve- 
nue, $415 million in additional Medicaid 
expenses, and $10 million annually in extra 
costs of incarceration for the state of Ohio. 

Justifying Charters 

The last section of the report attempts to es- 
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timate the benefits of enrollment in 23 spe- 
cialized “dropout recovery” charter schools, 
18 of which are “Life Skills Centers” oper- 
ated by White Hat Management. According 
to the data presented in the report, the 
schools have a wide range of success, with 
the probability of graduating from these 
charter schools lying roughly between 12% 
and 81%. But one should be skeptical of the 
data: the graduation counts presented in the 
report fail to match graduation counts avail- 
able from the Ohio Department of Educa- 
tion, and there is no description of any inde- 
pendent data collection activities conducted 
for purposes of the report itself. 

IV. The Report’s Use oe 
Research Literature 

The claims in each report implicate four dif- 
ferent areas of research literature: the meas- 
urement of high school graduation, the pri- 
vate and social benefits of educational at- 
tainment, the relative success of charter 
schools, and the literature on high school 
graduation and dropping out. The report 
makes reasonable if slim use of the literature 
in the first area: measuring high school 
graduation. But the report fails to acknowl- 
edge the important questions or findings of 
the existing literature in the other three ar- 
eas: charter schools, the factors shaping 
educational attainment, and the economic 
and other benefits of educational attainment. 

Measuring Graduation 

There is a growing literature on the prob- 
lems of measuring graduation, and the 
Buckeye Institute report does cite a small 
part of the relevant literature.'^ Researchers 
and other observers generally agree that 
states have chosen a variety of measures that 
artificially inflate graduation statistics. 
These approaches include the inflation of 
diploma counts by including GEDs, the use 
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of quasi-cohort measures that fail to adjust 
for migration of students among schools, 
and the use of administrative measures of 
dropping out even though this approach has 
historically resulted in undercounts. 

The Costs of Dropping Out 

There is extensive, published debate among 
economists about the benefits of educational 
attainment as well as the private and social 
costs of dropping out.^ A plurality of articles 
over several decades uses cross-sectional 
comparisons of income among people with 
different educational credentials to estimate 
the private benefits of attainment. These 
analyses, while allowing for only limited con- 
clusions to be drawn, are more sophisticated 
than the simple comparisons presented in the 
Buckeye Institute report. Moreover, econo- 
mists recognize several complicating factors 
in estimating the costs of dropping out. 

The largest point of controversy is over the 
meaning of a diploma: is it an indirect meas- 
ure of skills and knowledge acquired through 
education (an increase in human capital), or 
is a diploma a credential that is unrelated to 
alleged changes in human capital? The two 
variations of the dissenting position empha- 
size alternative uses of a credential. In the 
first version, education merely confirms in- 
trinsic traits of people who gained the higher 
degree, and so a credential signals these un- 
derlying traits (the human capital) more than 
it reflects anything learned in formal school- 
ing. In the other version, education replicates 
preexisting social inequalities, and so a cre- 
dential assists the labor market in justifying a 
sorting process that would happen anyway. 
These two versions have different implica- 
tions for the economic consequences of 
dropping out, and disentangling the human- 
capital from the credential functions of a di- 
ploma has presented a theoretical and meth- 
odological challenge to economists. 
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Most economists who find a human-capital 
effect acknowledge at least a partial creden- 
tial effect. To put it bluntly, if we could 
wave a magic wand so that everyone earned 
a high school diploma, the fact of universal 
graduation would not guarantee higher- 
paying jobs to all of the new graduates. 

A lesser point of controversy is a common 
confusion between the private and social 
benefits of educational attainment. On the 
one hand, the estimate of private benefits of 
education can tell us about the personal mo- 
tivation to continue in school (the expected 
return when compared to the opportunity 
costs of longer schooling), but that personal 
motivation is in an individual or family con- 
text. Because of a limited supply of well- 
paying jobs, when many people try to im- 
prove their position in a competitive labor 
market, that competitive motivation does not 
translate in a simple way into greater pro- 
ductivity for the entire economy, and it may 
decrease individual private benefits. 

On the other hand, the conflation of private 
with social benefits may mask benefits that 
only appear when looking at a population. 
When there is a critical mass of well- 
educated workers, companies may be more 
inclined to move to that location, and the 
critical mass may create a broader synergy 
that would be invisible when looking at a 
simple aggregation of private benefits. 

Finally, there are continuing debates over the 
best methods to estimate income effects of 
even simple private benefits, with some ac- 
knowledgment that private benefits depend on 
macroeconomic conditions. For example, 
since there is a time lag between today’s stu- 
dents and their later work life, a cross-section 
of today’s students and today’s workers may 
underestimate future benefits for students 
when wages are generally rising and may 
overestimate benefits when wages are falling.^ 
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None of these issues are addressed in the 
oversimplified presentation in the new report. 

Charter Schools 

The Buckeye Institute report does not ac- 
knowledge or consider any of the existing 
literature on charter schools. And there is a 
large body of useful research that could be 
considered. 

Graduation and Dropping Out 

Finally, the report makes no mention of the 
extensive literature exploring graduation, 
dropping out, and the factors that shape edu- 

o 

cational attainment. Because of this omis- 
sion, each report treats the educational proc- 
ess as a black box, as if the reasons why stu- 
dents drop out of school are largely irrele- 
vant to policymakers — which obscures other 
program options those policymakers could 
otherwise consider. 

Several of those alternatives deserve greater 
scrutiny by state policymakers, including 
preschool education, comprehensive inter- 
vention programs in middle and high 
schools, changes in child labor laws, and 
modifications of exit-exam requirements in 
states with mandatory exit exams. ^ 

IV. Review oe the Report’s 
Methods 

Previous sections of this review have dis- 
cussed weaknesses in the way that the Buck- 
eye Institute report ignored the literature on 
the benefits of educational attainment, on 
charter-schools, and on high school gradua- 
tion, as well as the report’s simplistic presen- 
tation of the costs of dropping out. Some ad- 
ditional concerns are warranted in terms of 
the report’s lack of documentation for its 
concrete claims about graduation from the 
last-chance charter schools. 
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The report provides two tables purporting to 
present graduation and cost data for 23 char- 
ter schools operating in Ohio in 2004-05. Un- 
fortunately, the data in the graduation table 
do not match the official Ohio Department of 
Education graduation counts for 2004-05.'*^ 
The Buckeye report over-reports graduates 
for those charter schools listed in the report’s 
Table 5 (page 9) that had graduation counts 
reported by the state of Ohio (data were 
available for 18 of the 23). For example, for 
the Life Skills Center of Columbus South- 
east, where Ohio says fewer than 10 gradu- 
ated in 2004-05, the report claims 145. For 
the Life Skills Center of Dayton, where Ohio 
says fewer than 10 graduated in 2004-05, the 
report claims 88 graduates. For Life Skills of 
Northeast Ohio, the state reported 42 gradu- 
ates, it claimed 338. Overall, for 18 schools 
for which Ohio reported a specific number of 
graduates, the report claimed 1,610 more 
graduates in 2004-05 than what the state re- 
ported. This documented exaggeration repre- 
sents approximately half of the total gradu- 
ates that the report claims for the 23 schools. 

Nowhere does the report explain the origins of 
the data in Tables 5 or 6 (page 10), let alone 
how there could be such a large discrepancy 
between the graduation counts in Table 5 and 
the official counts reported by the state. 

V. Review of the Validity of the 
Findings and Conclusions 

The one trustworthy conclusion of the report 
is that there are both private and social costs 
to dropping out, though the report’s facile 
estimates are likely to be inaccurate. 

The report’s conclusions about the benefits of 
last-chance charter programs are not trustwor- 
thy, because the data on the 23 last-chance 
charter schools named in the report are appar- 
ently inaccurate, and there is no reason to be- 
lieve from the report itself that its author inde- 
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pendently gathered the graduation-count data 
that are so far from official reports. 

In addition, readers of the report should be 
aware that the recommendation is not placed 
in the context of all policy options for in- 
creasing graduation and reducing the costs 
of dropping out. Even if the factual claims 
were trustworthy, the relevant issue for poli- 
cymakers is to select from the best options 
for increasing graduation. Even within the 
realm of school choice, the report failed to 
acknowledge the potential for specialized 
programs in local public schools to garner 
much of the hoped-for benefits of a last- 
chance charter-school program. 

Responsible researchers acknowledge the 
complexity of dropping out as a phenomenon 
and the different options that need to be 
weighed against each other, including pre- 
school programs, reducing class sizes, and 
community-level intervention in high school." 

VI. Usefulness of the Report 
FOR Guidance of Policy 
AND Practice 

Dropping out is generally acknowledged as 
a serious problem for the students who leave 
school and for larger society. The broader 
social costs include economic penalties for 
lower educational attainment; costs associ- 
ated with dependency; the potential damage 
to a democratic society of having a less- 
educated group of voters and jurors; and the 
damage to an egalitarian society when di- 
ploma rate differences are associated with 
social class, race, ethnicity, and the presence 
and nature of disabilities. While the Buck- 
eye Institute report dramatically simplified 
the costs, they are real. 

State policymakers might be tempted to 
view the report published by the Buckeye 
Institute as a rational response to such con- 
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cems. But the weaknesses described in this 
review should make clear the problems with 
relying on this report: the failure to respect 
the existing research literature in key topics, 
the mismatch between the report’s factual 
claims about the 23 named charter schools, 
and the failure to put the proposed recom- 
mendation in a context of different options 
to improve graduation. 

State policymakers would be better advised 



to consult a report issued in 2008 by the 
Brookings Institution, entitled The price we 
pay: Economic and social consequences of 
inadequate education. The book, edited by 
professors Clive Belfield and Henry Levin, 
more appropriately handles all of the issues 
identified in this review. Moreover, the pol- 
icy choices discussed in the Belfield and 
Levin anthology provide a more realistic 
basis for increasing graduation and reducing 
dropping out. 
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